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Abstract. From a viewpoint of stochastic thermodynamics, we derive equations 
that describe the collective dynamics near the order-disorder transition in the globally 
coupled XY model and near the synchronization-desynchronization transition in the 
Kuramoto model. A new way of thinking is to interpret the deterministic time evolution 
of a macroscopic variable as an external operation to a thermodynamic system. We 
then find that the irreversible work determines the equation for the collective dynamics. 
When analyzing the Kuramoto model, we employ a generalized concept of irreversible 
work which originates from a non-equilibrium identity associated with steady state 
thermodynamics. 
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1. Introduction 

Since the discovery of the fluctuation theorem EH El E], non-equilibrium statistical 
mechanics, which aims at connecting microscopic mechanics with macroscopic properties 
under non-equilibrium conditions, has been intensively studied. In particular, 
thermodynamic concepts such as heat, work, and entropy production are seriously re¬ 
considered so as to have a consistent thermodynamics framework for each realization 
of fluctuating quantities HI E]. This framework has been referred to as stochastic 
thermodynamics. Owing to much effort, nowadays, it can be said that the foundation 
of stochastic thermodynamics has been established, and we should consider a next 
challenge based on the development of stochastic thermodynamics. 

In the present paper, we discuss collective dynamics in systems consisting of many 
elements. This topic is of course one of important problems in non-equilibrium physics, 
but one may wonder how this problem is related to stochastic thermodynamics. Here, 
the first purpose of this paper is to shed light on the connection between collective 
dynamics and stochastic thermodynamics. A key point is that the deterministic 
time evolution of a macroscopic variable is interpreted as an external operation to a 
thermodynamic system, and the weak irreversible work is ascribed to a macroscopic 
friction force for the external system. The last phrase is taken from p. 192 in Ref. [4]. 
The combination of the friction force and the thermodynamic force gives rise to the total 
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force. When the total force is expressed in terms of the order parameter, a differential 
equation of the order parameter is determined. 

In section [2l we shall explain basic notions by analyzing the globally coupled XY 
model subjected to thermal noise. According to equilibrium statistical mechanics, the 
order-disorder transition point in this model is determined by a self-consistent equation 
for the order parameter characterizing the phase order. We then consider the time 
evolution of the order parameter near the transition point. Since its characteristic time 
scale is much longer than other variables, we interpret the time dependence of the 
parameter as a nearly quasi-static operation to the system. In the quasi-static limit, 
the so-called adiabatic theorem holds, which claims that the work is equal to the free 
energy change. We find that this relation is equivalent to the self-consistent equation for 
determining the transition point. Then, in nearly quasi-static processes, the irreversible 
work, which is defined as the difference between the work and the free energy change, 
appears slightly. Here, the irreversible work is characterized by a macroscopic friction 
constant. Since the irreversible work in nearly quasi-static processes is connected to 
fluctuations of irreversible work in the quasi-static processes, the friction constant is 
determined from the time correlation of a thermodynamic force at the trivial state. By 
calculating the friction constant, we obtain a differential equation of the order parameter. 

This method is elegant but seems applicable to only thermodynamic systems. As 
another example of collective dynamics, in section |3] we study the Kuramoto model 
which is the simplest model that describes the collective synchronization um- However, 
there are neither thermodynamics, equilibrium statistical mechanics, nor Hamiltonian 
in the Kuramoto model. The situation is rather different from the globally coupled 
XY model. Nevertheless, when we add a noise term to the Kuramoto model, the 
Langevin equation for each element is similar to that of the globally coupled XY 
model [9j. Only difference is that there exists a non-equilibrium driving force in 
the Kuramoto model. Thus, from a viewpoint of stochastic thermodynamics, the 
analysis of the noisy Kuramoto model requires an extension of the irreversible work 
and the fluctuation-dissipation relation. Here comes the steady state thermodynamics 
of Langevin equations [ilOj . We already found the generalization of the irreversible work 
in transitions between two steady states by extending the Jarzynski equality m to that 
valid in non-equilibrium systems. By using this extended equality, we derive a formula 
of the friction constant in terms of time correlation functions at the trivial state. As 
a result, we obtain a differential equation of the order parameter near the transition 
point of the noisy Kuramoto model. Furthermore, we can take the noiseless limit of the 
equation. 

It should be noted that the collective dynamics of globally coupled XY model and 
the Kuramoto model were studied by the so-called bifurcation analysis using a center 
manifold theory mmm- That is, in this paper, we do not derive new equations of the 
order parameters, but we present a simpler derivation method than previously known 
ones. In particular, if we already know the self-consistent equation, we have only to 
calculate the friction constant in terms of time correlation functions. The calculation 
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is quite elementary. Furthermore, by distinguishing “static quantities” such as the free 
energy and “dynamic quantities” such as the friction constant, we can gasp the problem 
in a clear manner. Therefore, we expect that the method will be applied to systems for 
which the collective dynamics are not studied yet. In the last section, we argue such 
future problems to be studied. Throughout this paper, the Boltzmann constant is set 
to unity, and ft is always identified with 1/T. 


2. Globally Coupled XY model 

2.1. Equilibrium Statistical Mechanics 

Let Oi (1 < i < N) be a phase variable of i-th element. We denote a collection of phases 
by 9 and define the Hamiltonian as 


K 


H (#) = c °s^' - °1 


hj 


The canonical ensemble of the system is given by 

p can (0) = -e-Pn^. 

Z 

We want to derive the equilibrium value of the order parameter defined by 

N 


re llf = 


— Y e i9j 

AT Z-^ 


N 


( 1 ) 


( 2 ) 


(3) 


3 =1 


with r > 0. 

We first notice that the Hamiltonian is expressed as 
H(9) = —Kr cos(dj — tp). 


(4) 


Although r and p depend on 9. we can assume that they take the equilibrium values 
(with probability one) in the limit N —> oo owing to the law of large numbers. We fix 
r and p to these values. We then write 




where 


with 






0 (3 Hon 


H one (6 ; r, p) = -Kr cos (9 - p). 

constant give 

d0e /3Kr cos(0)_ 


Z 0 ne (r) i s the normalization constant given by 

/•27T 

Z n „Jr) = / 


(5) 


( 6 ) 


(7) 


( 8 ) 


i o 
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The equilibrium value of r is then determined by 


N 


r = 


lim — cos(6b — <p) 

oo N V J 


1=1 


-2 TT 


dOp c ™M r , <p) cos (0 - <p) 


Zoneip ) 

1 d 


one 
r*2i t 

'o 


dOePKr cos(0) cos ( 0 ) 


PKfr logZ » n =( r) - 

By expanding (JSJ) in r, we obtain 

logZ one (r) = log(2vr) + |(/3 Krf - ^{fiKr) 4 + 0(r 6 ). 

The self-consistent equation (J2J) becomes 

r = hf3Kr) - ±-{f3Krf + 0{r b ). 

2 lb 

This indicates that the transition inverse temperature j3 c for fixed K is given by 

P C K = 2 . ( 12 ) 

Indeed, there are no other solutions than the trivial solution r = 0 for fd < /3 C , while 
there is another solution for (3 > (3 C . 


( 9 ) 


( 10 ) 


( 11 ) 


2.2. Collective Dynamics 

Next, we consider the collective dynamics of the order parameter. We assume that the 
time evolution of 6 t is described by the Langevin equation 
ddi _ _ ()II 
dt d6i 

K N 

= - sin (^ - 6 'j)+( 1 3 ) 

3 =1 

where C is Gaussian-white noise satisfying 

<&(%(0> = 2TM(* - 0- (14) 

The stationary probability density is the canonical distribution ((2]). The problem we 
want to solve is to obtain a differential equation of the order parameter re ltp . 

In order to set the problem explicitly, we assume the probability density at the 
initial time t = 0 as 

po(Q )= r °’ ^°) ^ i5 ) 

i 

for a given r 0 and <^ 0 - The probability density p(0,t) at time t is determined uniquely. 
Then, in the limit N — > oo, r(t ) and <p(t) for each t take definite values for almost all 6 
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with respect to p(0,t). We fix functional forms of r(t) and pit) to those. Since we can 
rewrite m as 

dfj. 

—j. = -Kr sin(0* - p) + (16) 

the probability density at time t is expressed as 

p{0,t) =Y[Pone(0i,t), (17) 


where p onc is given by the solution of the Fokker-Planck equation associated with (TT 6 T) : 


dp 0 


ae(0,t) 9 

dt + 89 


8 

-Kr sin (9 - p)p one - T —p 0 ne 


= 0 


(18) 


with the initial condition p one (6 , 0) = r 0 , po). Then, r(t) and pit) satisfy 

r(t)e^= d0p one (0, t)e ie , (19) 

Jo 

which is regarded as a self-consistent equation for r(t) and pit). 

Here, we make a symmetry consideration. Suppose that pit) = p 0 . Then, we can 
derive the solution as p 0 ne(9 , t) = p one (0 — po, t). This means that pit) = p$ is a solution 
of the self-consistent equation. Below, we set pit) = p 0 = 0. 

Now, we focus on the collective dynamics near the transition point. Explicitly, we 
set fJK = 2 + e with |e| -C 1 for fixed K. We then expect that the slow dynamics of r(t) 
are characterized by a scaling form 


r(t) = r] b r(rjt), 


( 20 ) 


where 77 —>■ 0 and t —> 00 with rjt = r fixed; and r is a function whose functional form 
is independent of 77 . We also expect that p is related to e as 


p = 



( 21 ) 


The question is to derive an equation for f and to determine the values of a and b. 

Mathematically, we have only to analyze p one near the transition point. One can 
apply a center manifold theory to this system. (See section 5.7 in Ref. [7].) Instead, 
we consider the problem from a viewpoint of stochastic thermodynamics. Hereafter, ( ) 
represents the expectation with respect to this initial distribution and the noise sequence 
£. We also denote the expectation of A{6) with respect to p one (9,t) by {A) t , and ( )^ an 
represents the expectation of the canonical ensemble with the Hamiltonian H one (9; r). 


2.3. Stochastic Thermodynamics 


We study the Langevin equation (ITS]) , where r is given as a function of time. We 
interpret the time dependent parameter as a control by an external system, without 
any feedback from the system. Concretely, the force <f> done by the external system is 
defined as 


$( 0 ;r) 


8H one (9] r) 

dr 


( 22 ) 
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By using j7J), we express r[t) determined in (fTUj) as 


r(t) = ( ( Hr)) t ■ 

According to equilibrium statistical mechanics, we have 

dF(r ) 


<*(r)>r = 


dr 


(23) 


(24) 


where F(r) is the free energy defined by F(r) = — Flog Z one (r). The self-consistent 
equation (EJ) is equivalent to (d>(r(t))) t = ($(r(i)))^. This is valid only in the limit 
t —> oo, and in general cases there should be the irreversible work defined by 

dF(r(s)) 


W irr = 

We then obtain 

d (War) 
dt 


rt , dr 
as— 
as 


'0 


$(0(s);r(s)) - 


dr 

dt 

dr 

dt 


(mm t - 

—Kr(t) - 


dr(s ) 

dF(r(t )) 
dr{t ) 
d F(r(t)) 


(25) 


dr(t) 


(26) 


The problem now becomes to evaluate the irreversible work in the stochastic system. 
The important property here is that the time scale of r is much longer than the relaxation 
time of the probability density for the Langevin equation (TT6|) near the transition 
point. That is, the control is assumed to be performed as a nearly quasi-static process, 
which enables us to develop a perturbation theory. Furthermore, owing to the recent 
progress on the stochastic thermodynamics, we have several identities associated with 
thermodynamic works. By utilizing one of them, we can simplify the calculation of the 
irreversible work. 

Concretely, we start with the Jarzynski equality m 


-/3Wirr) = 1 


(27) 


See Appendix A as for the derivation of a generalized version of fl27j) . By combining 
e~ x > 1 — x with the identity fl27lb we derive (W- m ) > 0, which corresponds to the second 
law of thermodynamics. Furthermore, from the identity (l27jh in the nearly quasi-static 
regime ij —> 0, we have 


<Wi„} = f (wl) + 0(,, 2 ). 


(28) 


which corresponds to the fluctuation-dissipation relation. By taking the derivative with 
respect to t, we obtain 


d (W iTT ) n dr f* dr . . . o. 

= P—I ds—B(t,s) + 0( V 3 ) 


with 


dt 


Bit, s) = 


dt 


®(0(t),r(t)) 


dF(r(t)) 
dr it) 


<h(0O),r(s)) 


dF(r(s)) 
dr(s ) 


(29) 


. (30) 
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The correlation time of $(0,r(s)) is controlled by T. Since dr(s)/ds ~ 0(rf) is much 
smaller than T , (129]1 becomes 


d{W- m ) 

dt 


... (I) 


+ 0(rf) 


(31) 


with a friction constant 
y(r) = 0 


ds 


$( 0 (s), r) 


dF(r) 

dr 


$(0(0), r) 


dF(r) 

dr 


(32) 


Essentially the same expression was obtained in Ref. [B]. Here, the expectation is taken 
over samples in which 0 ( 0 ) is chosen obeying the canonical ensemble with r, and 0 (f) 
is determined from the stochastic time evolution with fixed r. By combining (l3Tj) with 
we have 


7 (r(i))| = —Kr(t) - + 0(, 3 ). (33) 

This determines the time evolution of r(f) uniquely. By using the expansion (ITU]) , we 
rewrite (j33j) as 


C1T 

l{r(t)) -j t = ~Kr(t) +K 


\(PKr(t)) - i(/3AV(i)) 3 + 0(r(i) 5 ) 


+ 0(if 


(34) 


Recalling dr/dt = 0(rj) and j3K = 2 + e, we find that the exponents in (120T) and (|2TT) 
are given by a = 1 and b = 1/2. The equation for r(r) with r = rjt is 

. , dr , , K K n 

7(0)^; = sgn(e)—r - —r (35) 

in the limit 77 —>• 0 and t —> 00 . The positivity of 7 ensures the stability of the trivial 
solution f = 0 for e < 0 and the non-trivial solution f — 1 for e > 0, respectively. We 
also note that 7 > 0 implies the monotonic increment of W- m (see (13TTB . which is a 
stronger property than the second law of thermodynamics. 

Finally, we calculate 7 ( 0 ). From the definition of 7 in (l32lh we have 

POO 

7 ( 0 ) = PK 2 / ds (cos0(s) cos0(O))£!f o . (36) 

Jo 

Let C(t) be (cos0(f) cos0(O)) for the free Brownian motion dd/dt = £ which corresponds 
to the case r = 0 in the Langevin equation (1T6]) . We then derive 
dC 

— = - (sin 0 (f) o £(f) cos0(O))^ n o 
= - T (cos 0(f) cos 0(O))^ o 

= -TC, (37) 


where the symbol "o” represents the multiplication in the sense of Strotonovich. Since 
C(0) = 1 / 2 , we obtain C(t ) = exp(— Tt)/2. The substitution of this result into (136|) 
yields 

, . B 2 K 2 , . 
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which is evaluated to be 2 at the transition point. In sum, the differential equation for 
f is 

dr . K K 

dr w 4 4 v ' 

We guess that there should be some references reporting this result, say around 1970, 
but we do not find them. As far as we searched, explicit calculation was presented in 
Ref. [H] using bifurcation analysis. Note however that the numerical coefficient of the 
non-linear term in Eq. (7) of Ref. [Qj is not correct. 


3. Kuramoto model 


3.1. Model 


We study the Kuramoto model mi 


d0j 

dt 


K 


N 


= OJi 




(40) 


3 =1 

where K > 0 and cu* is a time-independent stochastic variable obeying the probability 
density g{u>). We assume that gioj) = g(—u>), g(oj) < g(0), and the second derivative of 
g(co) at u> = 0 is positive. Note that g(u) —>• 0 in uj —> oo because f dug(u) = 1. The 
collective synchronization occurs when K > 2/{jig(fS)). This result was obtained by the 
analysis of the self-consistent equation for the order parameter ((3]) , which corresponds to 
((9]) in the globally coupled XY model. After that, Kuramoto and Nishikawa attempted 
to derive the equation that describes the collective dynamics in the Kuramoto model 
ng. However, it turned out that the problem was hard to be solved. Especially, even 
in the linear regime around the trivial state (r = 0), the analysis was far from trivial, 
as pointed out in Refs. PHH7j. As one remarkable result, Ott and Antonsen derived 
the differential equation for the collective dynamics by noting a special solution of the 
non-linear equation of the distribution [18]. Note that this method relies on a special 
property of the model [HI (20] and that it cannot be applied to general cases. Quite 
recently, Chiba has derived the equation of the order parameter by mathematically 
developing a center manifold theory with a resonance pole im 

Since the difficulty originates from the deterministic nature of the dynamics, its 
noisy version 


7 n jy- N 

y- = Ui - — sin (^ - 9 1) + 6 ( 41 ) 

3 =1 

has also been studied, where Q is Gaussian-white noise satisfying (fTTjh This model was 
first proposed by Sakaguchi [9]. The self-consistent equation of the order parameter in 
this model was analyzed and the non-trivial solution corresponding to the synchronized 
state was derived |9|. Then, based on the linear stability analysis of the self-consistent 
solutions in the noisy Kuramoto model mm, bifurcation analysis was performed so 
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as to obtain a differential equation of the order parameter near the transition point [12] • 
(See Ref. |[2T] for a story related to the development.) 

In this section, we study the collective dynamics near the transition point for 
the noisy Kuramoto model from a viewpoint of stochastic thermodynamics. We then 
consider the noiseless limit T —> 0. 


3.2. Setup of the problem 


We start with re-expressing (l4Tf by 

= Wj - Kr sin(6>j - <p) + (42) 

We denote by p s f ne (9i,r,ip,uji) the stationary probability density for the Langevin 
equation (142|) with (r, ip ) fixed. We follow the analysis in the previous section step 
by step. 

We assume the probability density at the initial time t = 0 as 

Poip) = n Pone r 0, <Po,Vi) (43) 

i 

for given r 0 and <^ 0 . The probability density p{0,t) at time t is determined uniquely. 
Then, for each t, in the limit N —» oo, r(t) and ip(t) take dehnite values for almost all 6 
with respect to p(0,t). We fix functional forms of r(t) and <p(t). Then, the probability 
density at time t is expressed as 


p{0,t) = Y]_Pone(9 i: t]^i), 

i 


(44) 


where p one is given by the solution of the Fokker-Planck equation associated with the 
Langevin equation 


Spone (0; t, Uj) d 

dt + d9 


d 

(w - Kr sin(6> - p))p one - T—p 0 

at) 


= 0 


(45) 


with the initial condition p one (9, 0; uj) = p s f ne (9]r 0 ,(p 0 ,uj). Then, r(t) and p(t) satisfy 

/ r2n 

dug(uj) J d9p one (9,t',u)e ie , (46) 

which is regarded as a self-consistent equation for r(t) and pit). Without loss of 
generality, we assume <^ 0 = 0. Since p s f ne {— 0, t\ —uj) = p s f ne (9, t] uj), we find from (145]) that 
Pone(— 9, t: —uj) = p O ne(0) t] uj). Then, (l46|) leads to p(t) = 0. Hereafter, ( ) u represents 
the expectation over initial conditions and noise sequences in the Langevin equation 
(142|) with the frequency uji = uj. We denote the expectation of A(9) with respect to 
p one (9,t;uj) by (A) tu , and ( represents the expectation with respect to p° s ne (9; r, uj). 

Now, let K C (T) be the transition point of the coupling constant for the model with 
T fixed. We characterize the distance from the transition point by 


e = 


K - K c 
K c 


(47) 


Then, in the asymptotic regime |e| <C 1, we expect that r evolves slowly and this 
behavior may be characterized by a scaling form (120]) with (]2l]) . The question is to 
derive a differential equation for f together with determining the values of a and b. 
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Differently from the previous section, thermodynamic concepts such as the irreversible 
work are not established for transitions between non-equilibrium steady states. Indeed, 
the Jarzynski equality (127)1 is not available for the Langevin equation (1321) due to the 
existence of the driving force cu*. We thus need to consider an extension of the Jarzynski 
equality (127)) . This was proposed by Hatano and Sasa [TO] . By defining 

0(0; r,w) = -log^ s ne (0;r,a;), (48) 


they derived 


- So ds 


d</>(r(s),u 

dr\s) 


0 dr_ 

ds 


= 1 . 


(49) 


It should be noted that (1491) becomes the Jarzynski equality (127)1 when the stationary 
probability density is the canonical one. The quantity 

d(j>(r(s),oj) dr 


Y = T 


ds- 


(50) 


j o dr(s) ds 

is interpreted as a generalized irreversible work in a process starting from steady state. 
(See Ref. [22] for a review of an extended framework of thermodynamics on the basis 
of (US)) .) Next, since there is no Hamiltonian, we consider a different formulation from 
that using the thermodynamic force (122)) . Concretely, by defining 


A = —K cos 9 , 
and by recalling ([2]), we have 

- Kr(t) = f dwg{ui) {A) t 


(51) 


(52) 


The first step of the analysis is to estimate (A) t u in the nearly quasi-static regime rj — > 0. 
Here, as essentially the same identity as (149)) . we derive 

/ ri i dcj>(r(s),u}) dr \ 

( A >r(t),u> = ( Ae J ° ' SrW dS ) uj - ( 53 ) 

(See Appendix A for the derivation.) In the limit r/ —> 0, this identity yields 




t,UJ 


' , ds i JL/A(e(t)) d SS WyWiA) +0( y). (8 4) 


'0 


ds 


dr(s ) 


A similar relation was proposed by using the identity (149)) [23]. Furthermore, by noting 
the time scale separation, we rewrite it as 


n'T 

mt),co)-^(A) t ^-(A) s ; {tluj + 0(rj 2 ) 


with 


T(r, ca) = / ds(A(d(s)) 


d(fi(9(0);r,co) 


dr 


(55) 


(56) 


r,co 


This is a generalized fluctuation-dissipation relation claiming that the friction constant 
is expressed as the time correlation function. 
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Finally, multiplying g(oj) with the both hand sides of (1531) and integrating them in 
lu, we obtain 

nv 

70 r(t)) Tt = —Kr(t) - G(r(t)) + 0(rj 2 ), (57) 

where we have used f|52]) : and y(r) and G(r) are expressed as 


y(r) 

G(r) 


J dug(uj)T(r,uj), 

~K J dujg(u) (cos 0 )“ w . 


Since G(r) = —G(—r) (see Appendix B ), G(r) can be expanded as 
G(r ) = —air — a 3 r 3 + 0(r 5 ). 

The transition point K C (T ) is determined by 


(58) 

(59) 

(60) 


K c — (Ii\k=k c , (61) 

which is obtained from the condition that the linear term in the right-hand side of (1571) 
becomes zero. By substituting K = K c (l + e) and r = rf^rfqt) with rj = |e| into (1571) . 
we obtain 

d/T 

7 ( 0 ) 7 - = sgn(e)A' c f + a 3 f 3 (62) 

dr 

in the limit e —* 0 and t —> 00 , where 7 ( 0 ) and a 3 are evaluated at K = K C (T). 


3-4- Calculation of a±, a 3; and 7 ( 0 ) 

We expand Pone(^) r ^ UJ ) as 

1 OO 

Pone(0; A W) = — + ^ 9 n( 0 ; w)r T 


From 


and ( 160 ]) . we have 


n= 1 


r2n 


a\ = K / dugfjj ) / d6 cos 9qi(9]u), 


r 2n 


a 3 = K j dugiuj) J d6 cos 9q 3 (9] uj). 

By using expressions of qi and q 3 , which are given in Appendix B we obtain 
K 2 


ai = 


dug(uj) 


T 


w 2 + T 2 ’ 


a 3 = -T- 


IG 


dujg( u)- 


2G 


(63) 

(64) 

(65) 

( 66 ) 

(67) 


(u 2 + T 2 ) 2 (w 2 + 4T 2 )' 

The coefficients (1661) and (1671) in the expansion (1601) were already calculated [9], but the 
last term in Eq. (25) of Ref. [9] involves an error. By recalling (l 6 Tj) . we explicitly derive 
the transition point K C (T) as 


1 = 


K C (T) 


dug{u ) 


T 


LU 2 + T 2 


( 68 ) 








Collective Dynamics from Stochastic Thermodynamics 


12 


Next, we calculate the friction constant 7 ( 0 ). By using the expansion of the 
stationary probability density (163]) . we have (f) = log27r — 2irqir + 0(r 2 ). We then 
obtain 

1 


d S = _ K . 

dr to 2 + T 2 


(T cos 6 + casing) + 0(r) 


(69) 


in small r. (See Appendix B for the expression of q\.) By combining (1561) with (l69l) . the 
frequency dependent friction constant T( 0 ,u;) is expressed as 

1 


r(0,w) = K 


U‘ 


+ T 2 


dt[TC{t)+uD{t)}, 


(70) 


where C(t) = (cos9(t) cos#(0))^L 0aJ and D(t) = (cos9(t) sin#(0))^L 0a; . Here, as shown 


m 


Appendix C we derive 

/»oo 

/ dtC(t) = 


T 


r=0,u)' 


2 (u 2 + T 2 Y 

LO 


L dW(t) 2 K + T 2 )' 

By substituting (1711) and (172]) into (ITU]) , we obtain 


r(o, u) = K 2 


T 2 


u 


2(lu 2 + T 2 ) 2 

Therefore, the friction constant (1581) with r = 0 becomes 
7 ( 0 ) = K 2 [ dug(uj)- T 


j 2(cu 2 + T 2 ) 2 ' 

When g[uj) = h((u), the result becomes (1381) obtained in the previous section. 


(71) 

(72) 

(73) 

(74) 


3.5. Noiseless limit 


We consider the noiseless limit T —> 0. We first rewrite a± as 

01 = t S dU9(Tu) z? TT 

This immediately yields 

7 tK 2 . 

-9(0), 


lim a 1 = 

T- >0 2 


which leads to K c = 2 /(7177 (0)). Similarly, we obtain 


K 4 

lim a 3 = lim-- 

T->0 T—>0 4T 2 


dug(Tuj ) 


a; 


(cu 2 + l ) 2 cu 2 + 4 


tt/T 4 

TlT 


s"(0), 


(75) 


(76) 


(77) 


where the double prime represents the second derivative. Next, we evaluate the noiseless 
limit of 7 ( 0 ). The method used in the estimation of cq and 03 is not effective here. The 
heart of the calculation is to note an identity 


' j T 2 - w 2 n 


(78) 
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By using it, we rewrite (17-0) as 

7 ( 0 ) = K 2 J duj(g(oj) - g( 0 )) 

We then obtain 


T 2 


■ u 


2(tu 2 + T 2 ) 2 ' 


(79) 


lim 7 ( 0 ) = 

T—>0 


K 2 / <MsM“0(O)) 


2 w 2 


= -iC 

By substituting (1771) and (180]) into 


2 <WM-. 


-T 2 / 


2 cn 


, the equation of r becomes 


dr 7 t ^ 

— = sgn(e)if c f + ^ 9 "( 0 )f 3 , 


(80) 


(81) 


which coincides with Eq. (7.97) in Ref. [13j. The right-hand side corresponds to the 
self-consistent equation obtained by Knramoto [7]. Furthermore, we remark 

-1 


linir^o a 3 


9 "( 0 ) 


lim T ^o7(0) 4 tt^(0 ) 2 Vi 0 


dug'(uj) — 


U} 


(82) 


This expression corresponds to Eq. (138) in Ref. [12]. Although the numerical coefficient 
of the latter is different from (]82l) . there is no contradiction between the two, because |a| 
in Ref. na is equal to r/27r in this paper. (This unusual convention can be understood 
from Eq. (36) and Eq. (95) in Ref. [12].) 

More explicitly, we study a case that giuj) is a Cauchy distribution 

9{u) = ~ 2 T a2 - ( 83 ) 

7T C0 Z + A Z 

By substituting it into the formulas given in (1761) . (177]) . and (180|) . we obtain 


and 


.. A " 2 

= 2A' 

.. K* 

ter 3 =~sa5’ 


K 2 

lim 7 ( 0 ) = ——. 
t-v0 H ' 2 A 2 


becomes 


(84) 

(85) 

( 86 ) 

(87) 


Since K c = 2A (that comes from (l84l) h 
dv 

2— = sgn(e)ih c f — K c r 3 . 
dr 

Both the decay rate and the growth rate below and above the transition point are 
| K — K c | /2 in the original time scale, which are equal to the results of the linear stability 
analysis main]. The stationary solution above the transition point is equal to the result 
by Kuramoto (7|. Finally, the order parameter equation presented in Ref. pTS] becomes 
(187)) near the critical point. 
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4. Concluding Remarks 

In this paper, we have studied collective dynamics from a viewpoint of stochastic 
thermodynamics. The most important achievement is that we can obtain the order 
parameter equation (j8ll) quickly. The key step in the derivation is to utilize the 
fluctuation-dissipation relation (T54li that is derived from the non-equilibrium identity 
([53]) . Owing to this identity, we have only to calculate time correlation functions for 
a free Brownian particle driven on a ring, in addition to the previously known self- 
consistent equations urn- 

As is understood from the derivation method, the noiseless limit T — > 0 should 
be taken after the scaling limit e —> 0 and t —> oo is considered. When both T are e 
are finite, our theory provides a good approximation for e -C T. On the contrary, the 
calculation method cannot be applied to the noiseless Kuramoto model. Nevertheless, 
one may expect that the behavior for the case 6 < T -C 1 is close to that for e <C 1 
and T = 0. This expectation is true for some cases, but not always valid. For example, 
it was pointed out in Ref. in that when g[uj) is zero expect for [—cuo,<M>] with some 
positive cuo, the order parameter in the noiseless Kuramoto model relaxes to the trivial 
state in a power law form for K < K c , which is not observed for the case e T <1. 
We need to develop a different formulation if we want to understand the behavior of the 
noiseless Kuramoto model correctly m- 

Although we focus on the simplest model of coupled oscillators, one can study more 
general cases such that the interaction includes higher harmonics e.g. sin(0j — 6j) + 
h sin 2(6 r — 9j). See Ref. [25] for a self-consistent equation, Ref. [26] for the analysis 
using the center manifold theory of the noisy case, and Ref. G3 for the generalized 
center manifold theory for the noiseless case. According to Ref. 123, the early attempts 
[251126] have some mistakes. See Ref. [28] for a recent study. It should be noted that 
the symmetry property that leads to G{r ) = — G(—r) and ip = ipo is broken for the case 
h 0. This makes the calculation complicated. More importantly, it was shown that 
the value of the critical exponent b changes discontinuously in the noiseless limit. It 
would be a good problem to obtain a fresh view of this phenomenon by applying the 
method in this paper. 

So far, we have assumed that N oo. In finite but large N cases, we naturally 
expect that small Gaussian noise is added to the equation for the order parameter. We 
want to theoretically derive this stochastic equation. For example, one may start with 
the exact stochastic equation for the distribution 

1 N 

P%t) = - ( 88 > 

3 =1 

which is referred to as Dean’s equation [29] - Writing the path-integral expression for the 
history of p, one may combine the WKB analysis with the techniques in this paper. It is 
a challenging problem to complete the formulation. See Refs. [a eh ed] for arguments 
on finite size fluctuations. 
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Obviously, the exact determination of the differential equation for the order 
parameter relies on the mean field nature of the model. When we attempt to study 
models in finite dimensions, further techniques will be necessary so as to derive the time 
evolution of a spatially modulated order parameter. Then, a local stationary distribution 
for given spatial configurations of r and ip should be a reference state or an unperturbed 
state. Although it is a highly non-trivial problem to derive the equation, we should 
start this analysis seriously, because we have the simplest derivation of the collective 
dynamics in the mean-field model. The collective dynamics of coupled oscillators defined 
on random networks and complex networks are also worthwhile to be studied [321 [33]. 

Finally, we briefly mention a recent work in which the Navier-Stokes equation is 
derived from Hamiltonian particles systems using a non-equilibrium identity [3jj. This 
derivation method is formally correct and the most compact in existing approaches. 
Simplifying calculation enables us to extract the essence of the derivation problem, and 
thus we can now carefully review previous studies by Mori [35], Mclennan [36], Zubarev 
and Esposito and Marra [38], which will be reported elsewhere. However, the 
method in Ref. [31] involves some mathematical assumptions such as convergences of 
time correlation functions. Now, look into the Kuramoto model again. If we set T = 0 
in the integrand of (J79]), the friction constant 7 ( 0 ) diverges. Thus, the formal calculation 
does not make a sense. Similarly, in the argument of the hydrodynamic equation, we 
should check the well-defined nature of the dissipation constants. Maybe related to this 
issue, we point out that arbitrarily small noise is introduced even in mathematically 
deriving the Euler equation [39] . 

Stochastic thermodynamics formalizes thermodynamic concepts of fluctuating 
quantities. It is obvious from this definition that the framework is useful for analyzing 
small machines such as molecular motors. In addition to such direct application, 
universal formulas found in stochastic thermodynamics may be applied to several non¬ 
equilibrium dynamics. We hope that this paper will stimulate many researchers who 
work on various subjects. 
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Appendix A. Derivation of the Identity (15311 

We consider a time-dependent Markov chain on a finite set X, where a time series 
(x n )n=o with x n G X is generated by a transition matrix T(x n — > x n+ \ ;«„) with a 
time dependent parameter a n . We denote by P ss {x] a) the stationary probability of the 
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transition matrix T(x —>■ y\ a). That is, P s s (x; a) satisfies 

y^T(x -)• y ; a)P ss (x; a) = P ss (y, a). (A.l) 

X 

We then define the dual transition matrix T*(x —> y \ a) by 

P ss (x] a)T(x ->• y,a) = P ss (y, a)T*(y ->• x; a). (A.2) 


It should be noted that 'Yh x T*(y —* x; a) = 1. We then have a trivial identity 


1 ' **'U) ^ iv —1 5 l -' c iV— 1 ) 

-Pss(^0] C^o) rji/ \Pss{Xl,a\) . v 

—— -rT (x o —t xi; 00)75—7- \T\ x i —> x 2 ; «i) • • • 

ns(^i;«o) Psb[x 2 ;oi) 


(A.3) 


Here, by multiplying A(xat)P ss (xat; «at) to the both hand sides and taking the 
summation over histories (x n )^ =0 , we obtain 


(A) ss 


P ss (x,; a 0 ) 


Pss( x Ni Oj\r) \\ 

75—7-rA(xjv) ) , 

Pi bs{ x N) OCN-i) / 


(A.4) 


where (.4) for a trajectory dependent quantity A represents 


(4.)= ^2 P ss (x 0 -,a 0 )T(x Q xi,a 0 ) ■ ■-T(x N -ix N ;a N -i)A[{x n )^ =0 \. (A.5) 

Note that (1A.4|) is also valid for Markov chains on real numbers. 

Next, we study the following Langevin equation for a phase variable 9: 
dR 

% = m<*)+z, ( a . 6 ) 

where f{9 + 27r; a) = /(0;a) and f is Gaussian white noise satisfying (£(£)£(£')) = 
2 TS(t — t'). We denote the stationary probability density by p ss (0; a). We discretize the 
Langevin equation with a time interval At. Since this defines the Markov chain on real 
numbers, we have the identity (1A.4D . Then, by taking the limit At —» 0, we obtain the 
identity (I53T) . When we set A — 1, it becomes the identity (l49j) . 


Appendix B. Stationary probability density 

The stationary distribution of (l42jl with (r, (p) fixed is determined from 


(A - Kr sin0)p^ ne (0-r,uj) - Td e p s o s ne (0] r, u) = J{r,u), (B.l) 

where J(r,co) is a constant independent of 9. By substituting (1631) into (1B.1[) . we have 
uq n - Td e q n = K sin 9q n _ 1 + J n (B.2) 

with g 0 = l/(2vr) and J n is a constant. We solve this equation iteratively. Concretely, 
we calculate gi and g 2 as 
K 1 


9i = 


2ttco 2 + T 2 
K 2 1 


(T cos 6 + cusind), 


(B.3) 


2tt 2(cu 2 + T 2 )(lu 2 + 4T 2 ) 


Q2 = 


[(2T 2 — u> 2 ) cos 2 6 + 3 uT sin 20] . (B.4) 
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q 3 = ^33 cos 30 + c 33 sin 3 6 + 6 31 cos 6 + c 3 i sin 0, 

we calculate only 631 as 

K 3 T(2u> 2 - T 2 ) 

31 “ 2^2(cn 2 + r 2 ) 2 (cn 2 + 4T 2 )‘ 

As is nnderstood from these calculation, one can prove 


r-2-n- 


d6 cos 0 g n ( 0 ; oj) = 0 


(B.5) 


(B. 6 ) 


(B.7) 


for even integer n. This leads to G(—r) = —G(r ) from 


Appendix C. Derivation of (17111 and (17211 

We study the simple Langevin equation 

< ai > 

where £ is Gaussian noise satisfying (£(t)£(t / )) = 2 TS(t — t'). We shall calculate the 
time integration of the correlation functions C(t) = (cos 0(t) cos0(0)) and D(t) = 
(cos 9(t) sin 0(0)). We first consider the time derivative of the correlation functions. 
By using the equation (1C. Ill . we have 
dG 

= ojD(t) — TC(t), (C. 2 ) 


dt 

dD 

dt 


= — uC(t) — TD(t), 


(C.3) 


where we used D(t) = — (sin 0(t) cos0(0)) and C(t) = (sin 9(t) sin 0(0)). We note that 
(7(0) = 1/2 and D( 0) = 0. From (10.211 and (IC.3p . we obtain 


d 2 C dC , 2 2 x^/ x 


(C-4) 


where dC/dt | t=0 = —T/2. The time integration of (lC.4j) over the interval [0, 00 ] leads 
to 

T 


Jo dtC[t) 2 (o ; 2 + T 2 ) ’ 

The time integration of (IC.3jl yields 


LO 


L dw ^ = - 2 (w2+n 


(C.5) 


(C.6) 
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